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FOREWORD 


Within  the  Array  Research  Institute  for  the  Bchav'****!  and  Social 
Sciences  (ARI),  the  Human  Adaptability  and  Organizational  Effectiveness 
Technical  Area  performs  research  to  improve  the  performer ce  of  groups 
in  a  variety  of  military  systems  and  operational  uni -a.  Programs  in  the 
Technical  Area  include  research  in  human  sensory,  motor,  perceptual,  and 
cognitive  factors,  and  effects  of  stress  and  degradation  of  sensory 
cues  —  in  this  case,  the  problems  of  helicopter  crests  flying  at  nap-of-the- 
earth  (NOE)  altitude  (i.e.,  below  treetop  level)  to  evade  detection. 

This  report  reviews  the  technology  of  simulated  flight  training  and 
is  part  of  a  project  to  identify  specific  areas  in  which  Nf£  training  for 
aircrews  can  be  improved.  The  conclusions  of  the  study  are  being  pub¬ 
lished  as  an  ARI  Research  Report,  and  the  detailed  task  analyses  and 
training  objectives  from  which  the  conclusions  were  drawn  are  tabulated 
in  ARI  Research  Memorandtjm  7 6-2.  The  entire  project  was  done  in  close 
cooperation  with  the  Army  Avi.ition  School  at  Fort  Rucker,  Alabama;  the 
contributions  of  military  personnel  there  and  elsewhere  are  gratefully 
acknowledged.  Further  studies  of  human  resources  in  aviation,  including 
fLigbc  training  selection,  simulation,  and  NOE  training,  are  being  done 
by  the  ARI  Field  Unit  at  Fort  Rucker. 

ARI  research  in  aircrew  performance  is  conducted  as  an  in-house 
effort  augmented  by  contracts  with  organizations  selected  as  having  unique 
capabilities  for  research  in  flight  technology.  This  project  was 
conducted  jointly  by  personnel  from  ARI  and  Anacapa  Sciences,  Inc.  of 
Santa  Barbara,  California,  who  also  requested  Dr.  Roscoe  to  contribute 
his  experience  in  flight  training;  Dr.  David  Meister  of  ARI  directed  the 
project,  and  Mr.  Charles  A.  Gainer  led  the  research  fer  Anacapa.  The 
entire  project  was  conducted  under  Array  RDTE  Project  2Ql6£107A7k5,  FY  75 
Work  Program,  and  2Q7647I5A757,  FY  197U  Work  Program,  in  preparation  for 
responding  to  special  requirements  of  the  Assistant  Chief  of  Staif  for 
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Requirement: 


Io~*«viww  ^phe  state  of  the  art  of  aircrew  training  technology, 
particularly  in  simulation, "as  part  of  a  program  to  identify  areas  in 
which  nap-of-the-earth  (NOeI  aircrew  training  might  be  most  readily 
improved.  ' 

Review  Sunnary 

Ground-based  devices  that  simulate  f 1 i gh t  are  both  effective  and 
cost-effective  for  initial  flight  training;  with  time,  as  a  student's 
skill  increases,  the  simulator  becomes  decreasingly  cost-effective 
compared  with  actual  flight.  The  more  complex  and  costly  the  simulator, 
the  sooner  it  will  cease  to  be  cost-effective  but  the  more  realistic  its 
simulation  is  likely  to  be.  Optimum  fidelity  must  be  determined  for 
each  training  objective;  although  more  realistic  simulation  does  not 
necessarily  produce  more  effective  transfer  of  training  genera’  ly,  exact 
fidelity  is  vital  in  teaching  procedural  skills.  \ 

\ 

’Present  flight  simulators  are  much  less  useful  in  NOE  training  than  in 
general  helicopter  pilot  training  because  they  cannot  properly  reproduce 
the  visual  field  outside  the  cockpit. \  They  might  be  used  to  train 
pilots  in  procedures  to  cope  with  NOE-altitude  emergencies;  however,  a 
combination  of  cinematic  simulation  and  air  training  appears  to  be  the 
most  promising  cost-effective  method  Of  developing  NOE  visual  perception 
skills . 

Of  other  innovations  in  pilot  training,  computer-assisted  instruction 
can  be  used  for  any  lecture-type  training;  measurement  of  residual  atten¬ 
tion  could  be  useful  in  assessing  NOE  pilot  performance . f  Automatically 
adaptive  training  methods  are  not  presently  suitable  for  NOE.  Automatic 
performance  measurement  could  be  very  useful  to  provide  pbjective  assess¬ 
ments  once  the  pivotal  measures  that  correlate  highly  wi$h  total  perfor¬ 
mance  are  identified.  j 


Utilization: 

The  conclusions  of  this  review  of  existing  technology  were  used  in 
conjunction  with  training  objectives  derived  from  task  analyses  to 
suggest  improvements  for  NOE  aircrew  training.  These  suggestions, 
validated  by  the  results  of  ARI '  s  field  research  program,  were  used  as 
the  basis  for  the  experimental  MA?  Interpretation  Terrain  Analysis 
Course  ' MITAO'  now  being  evaluated  at  the  Army  Aviation  School,  Fort 
Rucker,  Alabama. 
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REVIEW  OF  FLIGHT  TRAINING  TECHNOLOGY 


SIMULATED  FLIGHT  TRAINING 


BACKGROUND 

Simulated  flight  training  has  come  a  long  way  from  the  clipped-wing- 
Penguin-type  trainer  of  World  War  I.1  During  World  War  II,  the  Link  C-3 
and  AN-T-lS  "blue  boxes"  and  their  close  descendents  —  the  School  Link, 
1-CA-l  and  l-CA-2  (Navy,  SNJ;  Air  Force,  P-1),  and  the  GA/-l--were  and 
are  effective  training  devices.  All  carefully  controlled  experiments 
have  supported  the  use  of  ground-based  trainers  during  initial  flight 
training. } 

Modem  flight  simulators,  featuring  complex  visual  and  motion  systems, 
have  demonstrated  effective  transfer  of  training,  although  they  have  not 
been  submitted  to  a  rigorous  experimental  evaluation.  The  dramatic  Ef/Jb 
reduction  in  helicopter  flight  hours  which  was  claimed  by  substitute 
training  in  the  Army's  2-B-2L  Synthetic  Flight  Training  System  '  SETS'1 
simulator  (Caro,  1/72;  1/73)  lends  suppor-.  to  the  conclusion  that  such 
complex  devices  are  effective  for  both  me  training  and  testing  of 
pilots . 


COST  EFFECTIVENESS 

The  key  requirement  in  the  design  and  use  of  simulated  flight 
trainers  is  cost  effectiveness.  That  is,  the  cost  of  the  feature,  and 
of  the  simulator  operating  time  associated  with  its  use,  must  be  no 
greater  than  the  cost  of  the  flight  time  required  to  achieve  the  same 
training  in  the  actual  aircraft.  To  make  this  determination,  the  use  of 
the  simulator  should  take  into  account  its  incremental  cost  effectiveness 
Micheli,  1/72;"  Roscoe,  Denney,  and  Johnson,  1/711  Povenmxre  and  Roscoe, 

iry>. 


The  Penguin  system  involved  a  clipped-wing  Bleriot  Aircraft  and  was 
used  for  preflight  training  for  single-seat  aircraft. 

The  early  transfer  of  training  studies  at  the  University  of  Illinois 
by  WiMiar.-S  and  Flexman  (lolr/a;  I'/t/b;  l/bQc)  were  followed  by  those 
of  Flexman,  Nathenv,  and  Brown  (.I/'/O')  ;  Flexman,  Roscoe.  Williams,  and 
Williges  (completed  in  1950  but  unpublished  until  37/72);  and  Payne  et 
ai .  195^'.  Two  studies  done  at  the  USAF  Basic  Pilot  Training  Re¬ 
search  Laboratory  using  the  Link  P-1  were  reported  by  Flexman,  Town¬ 
send,  and  Ornstein  (195*0  arid  by  Ornstein,  Nichols,  and  Flexman  1/(1 
Recently,  Povenmire  and  Roscoe  (1971;  l'/7?)  have  resumed  transfer 
research  at  the  University  of  Illinois  with  their  measurement  cf  the 
cumulative  and  incremental  transfer  effectiveness  of  the  Link  GAT-1. 


\ 
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Incremental  cist  effectiveness  refers  to  a  principle  of  diminishing 
returns;  training  in  a  simulator  on  any  flight  curriculum  yields  a 
diminishing  transfer  to  actual  flight  training.  At  some  point,  simulator 
training  becomes  cost  ineffective.  Of  course,  further  usr  of  the  same 
simulator  for  other  portiors  of  the  curriculum  may  continue  to  be  cost 
effective.  And  at.  times  it  may  be  good  training  strategy  co  use  a 
simulator  beyond  its  coni  effective  point,  for  example  in  bad  weather. 

Cost  effectiveness  of  a  synthetic  training  device  depends  both  on 
the  cost  of  the  device  and  on  its  transfer  effectiveness.  For  a  new 
training  device,  relatively  simple  features  may  become  the  rational  cost- 
effective  choice  when  the>  yield  only  slightly  less  transfer  than  more 
complex  and  costly  alternatives.  Stated  another  way,  training  may  be 
done  more  profitably  in  a  cheap  simulator  with  a  high  transfer  effective¬ 
ness  ratio  than  in  an  expensive  simulator  with  an  even  higher  one. 

The  cost  of  a  synthetic  flight  trainer  includes  not  only  the  purchase 
price,  housing  and  maintenance  expenses,  but  also  the  energy  required  to 
operate  the  device.  Although  no  existing  flight  simulator  expends 
energy  at  Che  rate  of  a  high-performance  military  aircraft,  the  original 
maintenance  costs  of  some  simulators  are  comparable  to  the  counterpart 
airplanet ,  Furthermore,  the  complex  motion  and  visual  systems  of  the 
mot*-  ad  'anced  contact  flight  simulators  and  their  supporting  computers 
require  several  timas  as  much  operating  power  as  their  counterpart 
undergraduate  flight  trainers  Thus,  to  be  energy  effective,  each  hour 
in  the  simulator  wouLd  have  to  save  aircraft  flight  hours  in  the  ratio 
of  the  energy  used  by  each  machine. 

Because  the  transfer  effectiveness  of  any  training  device  decreases 
as  tr  lining  time  increase..,  a  simulator  with  an  initial  positive  energy 
effectiveness  will  become  negatively  effective  for  each  student  after 
somt  neriod  of  training  on  any  individual  unit  of  instruction.  That 
point  might  easily  occur  before  the  student  has  reached  tne  desired 
performance  criterion  for  that  unit. 

Predicting  the  characteristics  of  a  helicopter  simulator  for  NOE 
operations  that  will  yield  high  transfer  effectiveness  rains  relative 
to  cost  requires  an  analysis  of  training  objectives  and  a  realistic 
assessment  of  the  current  state  of  the  simulation  art.  Discussions  of 
these  subjects  are  provided  by  Air  Force  Human  Resources  Laboratory 
Technical  Note  IT!  J-01  (Bell,  19?4) ;  Baum,  Smith,  and  Goebel  (1975); 

Caro  (1975);  McGrath  and  Harris  (1271);  Puig  (1970) ;  Smode,  Hall,  and 
Meyer  (l'j66) ;  Valverde  (1968,  1975);  Willeges,  Roscue,  andWilliges 
(lir 5)  ;  and  Watson,  Codes,  and  Hotz  (1971). 


STATE  OF  THE  SIMULATION  ART 

Although  flight  simulator  characteristics  for  NOE  training  cannot  be 
specified  without  considering  the  state  of  the  simulation  art,  the  state 
of  the  art  should  not  determine  by  default  the  specified  simulator 
characteristics.  Each  simulator  manufacturer  recommends  to  users  the 
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most  advanced  equipment  features  he  can  readily  produce.  Often  a 
laanufacturer ' s  recommendations ,  and  his  statements  as  to  what  he  can  and 
cannot  deliver  within  a  particular  schedule,  determine  the  character¬ 
istics  to  specify.  Iranediate  training  objectives  rarely  determine  these 
specifications.  The  temptation  is  to  buy  overly  complex  and  costly 
simulators. 

Willeges,  et  al.  illustrate  the  problem  as  it  manifests 

itself  in  the  specification  of  motion  system  characteristics: 

In  view  of  the  Large  sums  invested  in  the  design,  develop¬ 
ment,  and  production  of  complex  simulator  motion  systems, 
it  is  difficult  to  understand  why  there  has  been  no  objec¬ 
tive  controlled  experiment  to  assess  their  transfer  effec¬ 
tiveness  An  experiment  by  Matheny,  Dougherty,  and  Willis 
t  showed  that  relatively  faithful  cockpit  motion 

improves  pilot  performance  in  the  simulator,  presumably  by 
providing  alerting  cues,  and  recent  experiments  at  Ames 
Research  Center  Guercio  and  Wall,  11*2)  and  at  the  Aviation 
Research  Laboratory  of  the  University  of  Illinois  'Jacobs, 

Williges,  and  Roscoe,  1/’*;  Roscoe,  Denney,  and  Johnson,  1971' 
support  this  finding.  However,  there  is  no  evidence  one  way 
or  the  other  to  indicate  that  this  improvement  transfers  to 
flight.  The  general  experimental  finding  that  relatively 
difficult  training  tasks  yield  higher  transfer  than  easier 
ores  suggests  that  transfer  might  be  reduced  as  a  consequct.ee 
of  adding  motion  cues  that  make  the  simulated  flight  task 
eas ier . 

The  evident  reaon  that  large  sums  are  spent  for  simulator 
motion  systems,  with  no  evidence  of  their  training  value,  is 
their  high  face  validity.  A  high-fidelity  motion  system  is 
a  delight  to  any  pilot;  the  illusion  of  flight  is  extermely 
realistic.  The  decision  to  include  a  complex  motion  system 
is  invariably  determined  by  the  enthusiasm  of  pilots,  partic¬ 
ularly  one  in  high  places. 

The  visual  systems  situation  is  similar  in  some  respects.  Available 
options  ranf,e  from  the  relatively  simple  and  inexpensive  iFayne  et  al., 
lypL '  to  the  extremely  complex  and  costly  .Smith,  1972).  The  difference 
is  that  none  of  the  visual  systems  developed  to  date  are  entirely 
satisfactory.  Some  systems  severely  limit  the  field  of  view;  some 
severely  limit  the  maneuvering  area  and/or  altitude  range;  some  have 
unacceptably  poor  resolution  and/or  image  distortion;  some,  lack  color 
and/or  texture  and/or  daylight  representation;  some  tend  to  be 
unreliable;  pome  require  huge  amounts  of  energy;  some  present  serious 
radiation  hazards,  particularly  for  instructors  and  maintenance  person¬ 
nel;  and  all  tend  to  require  excessive  maintenance. 

A  visual  system  suitable  for  teaching  all  of  the  perceptual-motor 
and  decision-making  skills  required  for  NCI  tactical  helicopter  opera¬ 
tions  uoe:  not  exist.  Nor  is  it  likely  that  a  cost-effective  system 
which  meets  all  NOE  training  requirements  can  be  developed  at  the 
present  time.  The  decreasing  cost  of  high-speed  digital  computers  and 
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the  recent  advances  in  digitally-driven,  solid-state  displays  may 
eventually  provide  a  cost-effective  solution.  At  the  moment,  however, 
the  Inadequacy  of  visual  simulation  is  less  important  than  a  rational 
determination  of  the  visual  cues  essential  for  meeting  NOE  training 
objectives. 


TRAINING  OBJECTIVES 

Determination  of  static  and  dynamic  visual  cues,  dynamic  motion  cues, 
auditory  cues,  and  dynamic  vehicle  responses  to  be  simulated  should 
start  with  an  analysis  of  training  objectives  associated  with  the  appro¬ 
priate  mlssion--in  this  case,  nap-of-the-earth  helicopter  operations.  The 
training  objectives  for  NOE  (Gainer  and  Sullivan,  1976b)  may  be  classi¬ 
fied  under  the  following  set  of  behavioral  categories  useful  ir  speci¬ 
fying  associated  simulator  characteristics: 

PROCEDURAL  ACTIVITIES 

Communications  management 

Navigation  management 

Fuel  and  poverplant  management 

Vehicle  configuration  r  magement 

Sensor  management 

Weapon  management 

Battle  damage  management 

DECISION-MAKING  ACTIVITIES 

Navigation  planning 
Th'-eat  or  hazard  assessment 
Target  priority  adjustment 
Mission  priority  adjustment 
Crew  function  adjustment 

PERCEPTUAL- MOTOR.  ACTIVITIES 

Geographic  orientation 
Vehicle  control 

Target,  threat,  or  hazard  detection  and  identification 

Weapon  delivery  control 

Communication 

Each  of  the  training  objectives  fur  nap-of-the-earth  tactic.il 
helicopter  operations  can  be  classified  under  one  or  more  of  these 
behavioral  categories.  Consideration  of  previous  simulation  training 
reveals  that,  although  simulato’-s  have  proven  highly  effective  in  the 
teaching  of  procedural  skills  and  only  slightly  less  effective  for 
teaching  perceptual-notcr  skills  (Flesman,  et  al . ,  1972),  they  have 
rarely  been  used  to  teach  decision  making  skills.  This  is  not  surprising 
In  view  of  the  intangible  nature  of  sVch  skills,  and  che  difficulty  of 
defining  and  determining  good  decision-making  performance.  The  ability 
to  make  good  decisions  is  the  distinguishing  mark  of  the  effective  air¬ 
craft  conwar.der.  The  cultivation  of  these  skills  is  an  instructional 
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objective  calling  for  situational  training  that  may  be  carried  out 
safely  only  in  a  simulated  tactical  environment. 

Further  generalizations  can.be  made  concerning  interrelations  between 
training  objectives  and  simulator  character* sties  before  considering 
implications  for  the  role  of  simulation  in  NOE  training.  The 
Flexman  study  concluded  that: 

...higher  transfer  occurs  with  procedural  tasks  than  with 
psycuomotor  tasks  because  the  former  are  less  adversely 
affected  by  the  imperfect  simulation  of  such  dynamic  fac¬ 
tors  as  physical  motion,  visual  and  kinesthetic  cues,  and 
control  pressures. 

This  is  not  to  say  that  effective  transfer  of  procedural 
tasks  requires  less  fidelity  of  simulation  than  psycho¬ 
motor  tasks.  To  the  contrary,  the  conclusion  must  he 
that  procedural  fidelity  is  more  critical  than  dynamic 
fidelity  is  simulator  design.  Lack  of  procedural  fidelity 
results  in  the  transfer  of  incorrect  responses,  thereby 
yielding  negative  transfer  to  the  performance  of  correct 
procedures  in  flight. 

Another  consideration  when  determining  training  objectives  for 
simulators  is  the  relative  rate  of  forgetting  for  various  skill  catego¬ 
ries.  In  general,  once  perceptual-motor  skills  arc  learned,  they  are 
not  quickly  forgotten.  Former  pilots  often  land  an  airplane  safety  and 
smoothly  after  as  long  as  20  years  out  oi  the  cockpit.  Procedural 
skills,  an  the  other  hand,  are  quickly  forgotten.  A  World  War  II  pilot 
who  can  still  land  his  combat  airplane  safely  is  unlikely  to  be  able  to 
start  its  engines.  The  generalization  that  procedural  ski  Lis  are  for¬ 
gotten  more  rapidly  than  perceptual-motor  skills  was  confirmed  experi¬ 
mentally  by  Mengelkoch,  Adams,  and  Gainer  ,'19!>ti'.  The  fact  that  infre- 
quently-uscd  procedural  skills  can  be  retained  and  partially  forgotten 
ones  quickly  restored!  in  a  simulator  argues  for  maintaining  high  pro¬ 
cedural  fidelity. 


FIDELITY  REQUIP£MENTS 

Flight  training  devices  shouLd  help  train  pilots  to  fly  airplanes. 
Although  cockpit  motion  adds  realism,  thereby  improving  pilot  performance 
in  the  simulator  Feddersnn,  T>j1:  Guercio  and  Wal  1 ,  .  I'T’l: ,  Ince, 

Williges,  and  Roscoe,  1975;  Jacobs,  at  al.,  1973;  Roscoe,  et  a!..,  1  ,r  1  '  , 
no  evidence  yet  exists  that  cockpit  motion  in  a  ground-based  trainer 
improves  pilot  performance  in  an  aircraft.  The  issue  is  unresolved.  Nc 
transfer  of  training  experiment  has  been  conducted  in  which  either  the 
degree  or  fidelity  of  cockpit  motion  was  the  experimental  variable. 

It  has  bee  i  demonstrated  that  the  outcome  of  behavioral  engineering 
in  simulators  investigating  the  order  of  meric  of  flight  displays  can 
produce  quite  different  conclusions  from  experiments  conducted  in  flight, 
depending  upon  the  presence  or  absence  and  type  of  simulator  cockpit 
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notion  (Bauer schnidt  and  Roacoe,  I960;  Ince,  et  al . ,  1975;  Johnson  and 
Roscoe,  1*972;  Matheny,  et  al.,  1963;  Nygaaid  and  Roscoe,  1955;  Roaco*, 
et  al.,  1971 ;  Roscoe,  Hopkins,  and  McCurley,  1955;  Roscoe  and  Wiiliges, 
1'//  * ;  Roscoe,  Wilson  and  Deming,  V)*J* ;  Weisz,  Elkind,  Piers  tor  ff,  and 
Sprague,  lyoO;  Wiiliges  and  Roscoe,  1973'.  It  would  be  surprising  If 
the  degree  and  fidelity  of  cockpit  motion  did  not  influence  training 
effectiveness;  however,  the  nature  of  that  influence,  positive  or 
negative,  has  not  been  clearly  established. 

Koonce  (177V)  found  a  statistically  reliable  indication  that  the 
refreshment  of  Instrument  flying  9kill3,  as  measured  in  flight,  la 
enhanced  by  the  absence  of  cockpit  motion  during  practice  In  a  simulator 
immediately  before  flight.  As  a  result  of  this  finding,  the  first 
direct  experimental  investigation  of  this  question  has  been  undertaken 
at  the  Imiversity  of  Illinois  (evperimei  i  oy  R.  S.  Jacobs  and  S.  N. 
Roscoe'.  Transfer  of  training  from  a  modified  Link  general  aviation 
trainer  to  a  light  gpneral  aircraft,  using  a  flight  syllabus  that 
samples  procedural,  decision-making,  and  perceptual-motor  activities, 
is  being  measured  for  three  different  cockpit  motion  conditions.  These 
include  no  motion  as  a  reference  condition),  normal  washout  motion,  and 
•>  hybrid  washout  motion  condition  in  which  the  direction  of  cockpit 
motion  is  randomly  reversed  *>0  percent  of  the  time,  thereby  compounding 
the  conflict  between  visual  and  vestibular  cues.  In  the  transfer  control 
con  ition,  all  training  is  given  in  flight 

Similarly,  few  data  exist  to  help  determine  the  optimum  fidelity  of 
extra-cockpit  visual  simulation  for  contact  flight  training.  Perhaps 
the  light  airplane  will  wontinue  to  be  tne  most  cost-effective  and 
energy-effective  contacc  flight  trainer,  fixed-wing  or  rotary-wing,  for 
) ears  to  coroe.  Certainly,  flight  trainers  designed  to  teach  the  basic; 
contact  flight  skills  Involved  in  takeoff  and  landing  should  be  rela¬ 
tively  inexpensive  because  comparatively  few  flight  hours  in  relatively 
'.ow-cost  aircraft  need  to  be  saved.  However,  a  more  expensive  simulator 
is  justified  to  save  pre-solc  and  transitional  flight  hours,  because 
these  training  phases  are  disproportionately  dangerous  and  costly  in 
terms  of  damaged  aircraf*. 

Analysis  of  the  training  objectives  for  nap-of- the-e a-th  flight  and 
tactical  weapon  delivery  indicates  that  the  most  difficult  problem  area*- 
are  associated  with  cognitive  skills  rather  than  motor  skills.  Not  only 
are  procedural  activities  primarily  cognitive,  but  they  tend  to  be 
mission-specific,  or  at  least  specific  to  the  particular  aircraft  and 
operational  environment;  conversely,  oerceptual-motor  flying  skills 
tend  to  generalise  to  a  range  of  aircraft  and  missions.  Although  nap-of  - 
the-earth  flight  control  requires  a  fine  touch  and  sustained  attention, 
it  involves  the  same  flying  skills  as  takeoff  ar.d  landing,  hovering,  and 
formation  flying..  In  contrast,  the  perceptual  and  decision-making  skills 
required  to  maintain  geographic  orientation  during  NOE  flight  are  not 
called  for  in  r.ny  other  type  of  flight  operation  (McGrath,  1972). 


Avoiding  the  use  of  helicopters  to  teach  NOE  flight  might  warrant 
the  development  of  fairly  complex  synthetic  training  devices.  The 
difficulty  of  teaching  NOE  flight  is  strongly  associated  with  geographic 
orientation  and  tactical  decision  making,  and  these  training  require* 
ments  demand  high  fidelity  of  the  visual  environment.  Because  a 
synthetic  system  that  satisfies  all  requirements  for  simulating  the 
visual  field  is  likely  to  be  inordinately  expensive,  there  is  ample 
reason  to  question  the  practicality  of  flight  simulators  for  teaching 
many  of  the  skills  unique  to  NOE  operations.  Light  aircraft,  part-task 
trainers,  motion  pictures  and  video  tapes,  cinematic  simulators,  and 
digital  teaching  machines  are  among  the  available  alternatives. 

One  issue  in  synthetic  flight  trainer  technology  remains  undisputed: 
The  importance  of  procedural  fidelity.  Although  it  is  logistically 
difficult  to  keep  changes  in  simulator  cockpits  consistent  with  changes 
In  operational  aircraft  c-.ckpits,  the  consequences  of  not  doing  so  are 
tutoi-ially  disastrous. 


INNOVATIONS  IN  PILOT  TRAINING 

Meeting  the  Amy's  training  objectives  for  nap-of-the-earth  flight 
operations  may  be  facilitated  by  the  imaginative  application  of  recent 
innovations  in  pilot  training.  Among  innovations  that  should  be 
considered  are  automatically  adaptive  training,  computer-assisted 
Instruction,  adaptive  measurement  of  residual  attention,  automatic  per¬ 
formance  measurement,  cinematic  simulation,  and  the  use  of  interactive 
compo.ter-control-diaplay  devices. 


AUTOMATICALLY  ADAPTIVE  TRAINING 

Although  all  individualized  training  is,  in  a  sense,  adapted  to  the 
individual  student’s  progress,  the  term  adaptive  training  refers  to  the 
automatic  adjustment  of  the  training  task  as  a  function  o2  the  student's 
automatically  measured  performance  (Kelley.  1969a;  1969b;  McGrath  and 
Harris,  1971) .  The  task  variable  that  is  adjusted,  called  the  adaptive 
variable,  may  be  the  difficulty,  complexity,  or  newness  of  the  training 
task  (Crooks  and  Roscoe,  197?;  McGrath  and  Harris,  1971;  Williges,  et  al 
Iff'?).  ?or  example,  the  difficulty  of  nap-of-the-earth  flight  control 
might  be  adjusted  by  automatically  increasing  the  ruggedness  of  the 
terrain  as  the  student’s  performance  improves;  the  complexity  of  his 
task  might  be  adjusted  by  increasing  the  frequency  of  concurrent  radio 
communications;  and  new  task  elements  might  be  introduced  by  simulating 
enemy  ground  fire  when  the  student  achieves  specified  proficiency  levels 
in  flight  control  and  communication  procedures. 

The  principal  difference  between  automatically  adaptive  training  and 
the  adjustment  of  training  tasks  by  a  flight  Instructor  is  that  automa¬ 
tion  requires  that  all  decision  rules  for  adjusting  the  task  be  prede¬ 
termined.  This  requires  a  formal  structuring  of  the  complete  training 
process  in  advance. 


Although  adaptive  training  has  been  studied  in  the  laboratory  for 
more  than  a  decade 3  Its  first  attempted  application  to  the  routine 
training  of  pilots  was  incorporated  in  the  Army's  SFTS  helicopter 
simulator  (Caro,  1969,  1973;'  Clausen,  Curtin,  and  Egler,  1*368;  Jameson, 
Walsh,  Flexman,  and  Cohen,  1 968;  McGrath  and  Harris,  1971;  Walsh  and 
Flexman,  1970;  Young  and  Hall,  1968) .  Because  of  the  lack  of  prior 
systematic  study  in  the  selection  of  adaptive  variables  and  the  stabili¬ 
zation  of  adaptive  logic,  the  initial  implementations  have  not  yet  been 
used  in  routine  training.  The  only  two  adaptive  variables  which  have 
been  manipulated  were  the  severity  of  air  turbulence  while  flying  an 
1LS  approach  (increasing  as  the  student's  control  improves')  and  the 
stability  of  cyclic  control  dynamics  during  hover  (decreasing  as  the 
student  learns  to  control  an  initially  stable  vehicle). 

Subsequent  research  at  the  University  of  Illinois  has  led  toward  a 
better  u  derstanding  of  the  dynamics  of  intraserial  effects  during 
adaptive  training  in  manual  control  (Crooks  and  Roscoe,  1975) .  Had  this 
research  been  done  before  the  SFTS  was  designed,  it  could  have  predicted 
that  adjusting  the  control  dynamics  of  the  simulated  helicopter  from 
stable  to  unstable  might  interfere  with,  rather  than  facilitate,  learning. 
By  changing  control  dynamics  as  learning  occurs,  different  responses  to 
the  same  display  indications  are  required  from  one  point  in  training  to 
the  next.  Although  the  training  task  progresses  from  easy  to  difficult, 
as  desired,  response  patterns  just  learned  must  be  replaced  as  they 
gradually  become  inappropriate.  Students  who  practiced  with  unstable 
control  dynamics  from  the  beginning  attained  proficiency  more  quickly 
than  most  of  the  adaptively  trained  groups. 

The  fret  that  the  automatic  adjustment  of  control  dynamics  was  found 
to  be  maladaptive  (in  this  one  experiment  at  least)  should  not  discourage 
the  further  use  of  automatic  adaptation  of  task  difficulty,  complexity, 
or  newness.  It  merely  indicates  that  care  must  be  used  to  select 
adaptive  variables  that  do  not  produce  Intraserial  habit  interference, 
and  to  tune  the. adaptive  logic  to  the  dynamics  of  human  learning. 

Although  a  clearly  effective  implementation  of  automatically  adaptive 
flight  training  has  yet  to  be  established,  the  principles  governing 
its  optimization  are  being  studied  at  the  University  of  Illinois 
(Wulfeck,  Prosin,  and  Burger,  1973)  and  the  Naval  Missile  Center,  Point 
Mugu,  California  'Ehrhardt,  C&vallero,  and  Kennedy,  1973).  The  basic 
idea  is  good. 


See,  for  example,  Birmingham,  1959;  Birmingham,  Chernikoff,  and 
Ziegler,  1962;  Chernikoff,  1962;  Crooks  and  Roscoe,  1973;  Damos,  1972; 
Hudson,  196c,  1961;  Kelley,  1965,  1966,  1967;  Kelley  and  Prosin,  1968; 
Kelley  and  War go,  1967;  Lowes,  Ellis,  Norman,  and  Matheny,  1963; 
Matheny  and  Norman,  1968;  Mirabella  and  Lamb,  i960;  Paste  and  Lewis, 
1962;  Wood,  1969. 


COMPUTER- ASSISTED  INSTRUCTION 


Automatically  adaptive  flight  training  is  one  fcrm  of  computer- 
managed  instruction;  programmed  cognitive  training,  which  may  or  may  not 
be  adaptive,  is  another.  However,  the  term  computer-assisted  instruc¬ 
tion  (CAl)  refers  to  programmed  learning  in  which  an  automatically 
branching  logic  allows  each  student  to  progress  at  his  own  rate  (Atkinson 
and  Wilson,  1969;  Bitzer  and  Johnson,  1971 »  Crowder,  1959;  Glaser,  19^5; 
Holding,  1965;  Lewis  and  Pask,  1965*  Lumsdaine  and  Glaser,  i960;  Pask, 
i960;  Skinner,  1958;  Trollip  and  Roscoe  1972).  Programmed  learning  is 
not  necessarily  cognitive  in  nature;  some  recent  CAI  programs  teach 
psychomotor  skills. 

CAI  is  being  applied  to  an  established  flight  curriculum  at  the 
Institute  of  Aviation  of  the  University  of  Illinois  (Trollip  and  Roscoc, 
19^2).  Initially,  training  in  VOR  navigation  procedures  is  being  done 
with  the  PLATO  uystem,  which  eventually  will  have  terminals  throughout 
the  nation  and  in  some  foreign  countries.  PLATO  it  the  acronym  for  Pro¬ 
grammed  Logic  for  Automatic  Teaching  Operations  (Bitzer  and  Johnson,  1971). 
PLATO  TV,  the  operational  version  of  the  system,  is  now  in  regular  use; 
it  appears  to  be  the  only  system  currently  applied  to  aviation  training. 

PLATO  Interacts  with  each  student  by  presenting  information  and 
reacting  to  student  responses.  The  instructor,  or  author,  establish*** 
the  rules  for  every  possible  situation.  An  ingenious  and  thorough 
instructor  car,  construct  a  set  of  rules  with  a  flexibility  approaching 
that  possible  for  a  human  tutor--and  rules  are  established  In  advance 
rather  than  spontaneously.  In  contrast  to  a  conventional  ground  school 
classroom  (in  which  an  instructor  manages  many  students  simultaneously 
and  seldom  gives  opecial  attention  to  an  individual  student),  PLATO 
appears  to  give  each  student  undivided  attention  becau'io  It  normally 
responds  to  each  student's  input  In  a  fraction  of  a  second.  In  this 
manner,  each  student  receives  rapid  feedback  of  result*.,  and  now  Informa¬ 
tion  or  questions. 

The  display  capabilities  of  PLATO  allow  instructors  to  present,  or 
students  to  call  up,  stored  graphic  materials  (such  as  special  characters, 
map 8 ,  photographic  slides,  and  printed  or  audio  messages),  end  to 
construct  geometric  figures  or  graphs  activated  by  commands  of  either 
the  instructor  or  the  student.  A  graphic  display,  for  example,  might 
allow  a  student  to  specify  a  route  for  NOE  flight  on  a  topographic  map. 

The  computer  could  then,  from  stored  elevation  end  vegetation  contours, 
display  the  changes  in  masking  as  the  helicopter  moves  along  the  route 
at  a  designated  clearance  altitude. 

Adaptive  branching,  individual-progression  logic,  and  related  CAI 
techniques  have  already  been  applied  in  computer-managed  pilot  training 
systems,  notably  in  Device  2-B-24,  the  Army's  BFT8  simulator  at  Fort 
Rucker,  Alabama.  When  fully  implemented,  the  SFTS  computer  will  monitor 
and  evaluate  student  performance  on  selected  flight  tasks;  ft  may  require 
the  student  to  repeat  the  same  task,  ad /anc  to  a  new  task,  or  return  to 
a  previously  mastered  task  for  refreshment.  Upon  request,  the  student 
may  observe  a  demonstration  of  the  required  performance  by  the  computer. 


The  rapidly  increasing  sophistication  and  decreasing  coat  of  computer* 
generated  graphic  display  systems  show  promise  of  near-term  application 
to  training  in  real-time  NOE  tactical  decision-making • 

Although  CAI  systems  such  as  PLATO  IV  are  capable  of  certain  types 
of  perceptual-motor  tasks  simulation,  thoir  primary  application  to  NOE 
flight  training,  testing,  and  currancy  maintenance  appears  to  ba 
cognitive.  These  applications  might  extend  to  the  types  of  dtclsion- 
making  skills  called  for  in  different  tactical  situations,  some  of  which 
tequire  estimation  of  conditional  probabilities  and  risks  associated 
with  alternative  courses  of  action  in  the  face  of  uncertain  enemy  force 
deployment.  Three-dimensional  navigational  and  ballistic  problem 
solutions  are  typically  required  in  the  NOE  tactics. 

Considerable  ingenuity  will  be  required  to  produce  training  exercises 
useful  for  developing  decision-making  skills  and  communicating  knowledge 
required  for  NOE  operations,  but  the  potential  clearly  axlsc*.  The  Army 
Infantry  School's  current  programmed  map  reading  course  might  offer  a 
starting  point  for  the  application  of  CM  technology  to  NOK  training. 
Enrollment  in  the  existing  course  would  refresh  map-reading  skills  and 
CAI  student  procedures  for  pilots  entering  NOE  training.  With  the 
application  of  a  suitable  computing  and  graphic  display  system,  course 
scenarios  and  software  programs  could  be  developed  In  NOR  map  lnterp-e' 
ration  for  geographic  orientation,  terrain  and  cover  analysis,  route 
select ion,  and  evasive  maneuver  anticipation. 

The  development  of  any  CAI  course  should  not  be  undertaken  without 
full  apprscistlon  of  the  tutorial  ingenuity,  attention  to  detail, 
mastery  of  subject  matter,  and  amount  of  of fort  required,  Often  individ¬ 
uals  who  have  dsvel„pod  or  i local  /  /'served  film  dev* lucent  of  evr 
CAI  progrsms  (end  who  jre  griet'.,lly  enthusiastic  advoan  ,e»  of  1A1 
application^  tend  to  mlnisJre  the  perrons i  invMtMiu  lam.ired  -or 
sucoase,  As  s  consarvatlve  comparison,  the  developed  of  so  wffeo.Mve 
CAI  program  is  surely  ,»  isoto  fe/mldebu  exarriso  loan  wvittng,  tUuiire- 
tlng,  and  publishing  a  textbook  vtvcrlng  thu  soma  narevlpl  in  'orrespnn. 
ding  data! 1 . 


ADAPTIVE  MEASUREMENT  OK  RESIDUAL  ATTENTION 


WOE  task  requirements  place  unparalisd  demands  r,n  the  pilot's 
attention.  Skill  In  Tapld  time -sharing  of  attention  among  competing 
demands  is  a  Jieraerarlacic  that  distinguishes  the  effective  NOE  crew. 
The  automatic  measurenwnc  of  a  pilot’s  residual  attention  while  parfor- 
ming  demanding  routine  operations  not  only  discriminates  among  pilots 
of  differing  native  ability  but  also  uervas  to  assess  the  currancy  of 
skilled  pilctr  and  their  rtodineso  to  cope  with  the  occasional  abnormal 
workload  demands  oi  combat  or  equipment  malfunction  (Roscoe  and  Kraus, 
1775). 
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Investigators  4  studying  a  variety  of  aviation  problems  favor  the  use 
of  cockpit  side  tasks  for  at  Least  three  related  purposes:  il’  to  create 
elevated  cockpit  workload  pressures,  thereby  flushing  out  inherent, 
differences  among  primary  task  performances  as  a  function  of  some  display, 
control,  or  procedural  variable;  (2)  to  ahlft  sublet  priorities— for 
example,  making  the  subtask  being  measured  secondary  rather  than  primary 
in  the  pilot'a  priority  hierarchy;  and  (3^  to  measure  the  piloi'r 
residual  attention  aa  ar  inferential  index  of  the  workload  demands  of 
his  higher  priority  auhtask*. 

The  automatic  measurement  of  residual  pilot  attention  has  reliable 
variations  of  individual  differences  among  pilots,  pilot  currency,  and 
the  display,  control,  or  procedural  variables  being  studied.  This 
supports  the  idea  th»*„  residual  attention  capacity  might  be  a  ba»is  for 
selecting  sudent  pilots,  and  might  be  used  as  a  test  of  currency  or 
combat  reaii.eas  for  experienced  pilots. 

To  date,  the  use  of  side  tasks  for  the  measurement  of  residual 
attention  has  been  applied  only  in  the  experimental  study  of  flight 
displays,  controls,  and  procedures,  and  in  the  prediction  of  success  in 
pilot  training.  However,  these  experiments  show  that  the  technique  can 
produce  a  powerful  learning  effect  in  the  Important  areas  of  attention¬ 
sharing  and  decision-making.  Furthermore,  because  pilots  decrease 
slightly  in  flying  skill  over  long  periods  of  inactivity  but  their  pro¬ 
cedural  efficiency  drops  quickly  and  seriously  (particularly  in  flight 
situations  requiring  attention-sharing  and  quick-decision  responses) , 
the  automatic  measurement  of  residual  attention  can  provide  a  quick 
check  on  an  experienced  pilot's  procedural  currency  as  well  as  on  a 
student's  initial  attainment  of  proficiency. 

The  introduction  of  an  attention-demanding  side  task  while  a  student 
p_?ot  is  atr«swp»it»g.  to  fly  an  NCE  «ii:<  ror.  (in  either  a  helicopter  or  a 
flight  simulator'’  can  lead  auccsa's to  mnoyauce,  frustration, 
hostility,  aud  panic.  Nevertheless,  pilots  learn  to  divide  the!1- 
attention  to  cope  with  multiple  task  demands,  and  the  substantial 
transfer  of  such  learning  to  operational  situations  involving  cockpit 
work  overload*,  can  be  achieved  with  complete  safety  to  student  and 
Instructor.  Although  independent,  attention-dem&r.ding  side  tasks  may 
inhibit  the  learning  of  primary  NOB  flight  tasks  initially,  the  eventual 
capacity  to  handle  primary  tasks  while  coping  with  distractions 
strengthens  the  pilot's  ability. 


See:  Damos,  1972;  Damos  and  Roscoe,  1970;  Ekstrom,  1962;  Hamilton, 
1969;  Hartman  and  McKenzie,  1961;  Lazarus,  Deeie,  and  Osier,  1952; 

Kraus  and  Roscoe,  1972;  Lindsay,  Taylor,  and  Fcrbes,  1968;  Pope,  1962; 
Siebel,  Christ,  and  Telchner,  1965;  Slocum,  Willlges,  and  Roscoe,  1971, 
Smith,  1969;  Soliday  aud  Schohan,  1965- 
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AUTOMATIC  PERFORMANCE  MEASUREMENT 


A  great  deal  ha*  been  written  about  automated  measurement  of  pilot 
performance  and  its  potential  fcr  providing  a  diagnostic  record  of  the 
student  pilot'*  progress  in  flight  training  (Baum,  et  al.»  1975;  McGrath 
and  Harris,  1971;  Knoop,  1966,  19^7,  1968).  Nevertheless,  the  problem* 
and  methods  of  measuring  pilot  performance,  either  automatically  or 
manually,  are  not  well  understood.  An  initial  difficulty  la  associated 
with  the  misconception  that  performance  measurement  is  basically  an 
instrumentation  problem,  and  that  no  problem  would  exist  if  suitable 
instrumentation  were  available  In  every  training  aircraft  and  simulator. 
Although  some  instrumentation  is  inevitably  required,  this  is  a  trivial 
aspect  of  the  problem.  The  important  aspects  of  pilot  performance 
assessment  fall  into  two  categories:  defining  the  indices  of  desired 
performance,  and  sampling  the  indices  of  actual  perfonsance . 

The  task  of  flying  a  helicopter- -or  operating  any  other  vehicle-- 
involves  making  a  series  of  discriminations  and  manipulations.  Discrim¬ 
inations  must  identify  the  indices  of  desired  performance,  or  subgoals, 
which  must  be  met  to  achieve  the  overall  goal  of  the  mission.  By 
manipulating  coutrols,  the  pilot  tries  to  match  the  indices  of  actual 
system  performance  to  the  identified  indices  of  desired  performance.  How 
closely  he  does  so  is  the  objective  measure  of  the  quality  of  hia  perfor¬ 
mance. 

Thus,  measurement  of  pilot  performance  must  deal  with  indices  of 
desired  and  actual  performance- -the  pilot's  ability  to  discriminate  the 
former  and  to  manipulate  the  latter.  Historically,  flight  performance 
assessment  has  focused  on  a  pilot’s  ability  to  execute  specified 
maneuvers  in  which  the  indices  of  desired  performance  are  given,  but 
even  here  the  lack  of  standardization  has  caused  uncertainty.  Different 
’"nstructors  vary  widely  in  their  own  performances  of  the  same  maneuvers, 
and  different  check  pilots  base  their  scoring  on  widely  differing 
indices  of  desired  performance.  Consequently,  the  first  problem  in 
assessing  NCE  flight  performance  is  to  define  flight  tssks  that  require 
the  pilot  to  discriminate  indices  of  desired  performance  correctly.  The 
perrormac.ce  measurement  system  must  know  the  correct  indices  of  desired 
performance. 

The  establishment  of  desired  performance  Indices  for  NOE  flight  must 
be  done  if  automatic  performance  measurement  is  to  have  any  validity. 
Furthermor-*,  desired  performance  indices  must  be  defined  for  procedural 
and  decisii  n-making  flight  activities,  as  well  as  for  perceptual 'motor 
activities,^ and  all  must  be  based  on  the  specified  training  objectives. 

Cnee  de>ir<.j  performance  indices  are  identified,  automatic  measure¬ 
ment  requires  only  that  instruments  sample  the  corresponding  indices  of 
actual  performance  economically  and  meaningfully.  A  major  problem  with 
typical  instrumentation  systevs  is  that  they  produce  continuous  records 
of  too  many  dependent  variables  for  either  the  instructor  or  the 
student  to  digest  and  comprehend  quickly  In  the  training  environment . 

The  solution  Is  to  determine  which  tew  variables  correlate  sufficiently 
with  the  composite  of  all  relevant  performance  measures.  Only  these 


need  be  monitored.  Conceivably,  a  single  performance  variable  could 
correlate  so  highly  with  the  composite  of  many  variables  that  it  alone 
would  be  a  sufficient  basis  for  scoring  the  entire  performance  (Roscoe, 
1948;  Roacoe,  Hosier,  and  Dougherty,  1966) . 

Although  it  is  seldom  possible  to  assess  the  performance  of  a  complex 
task  by  making  a  single  observation,  it  is  usually  possible  to  do  so  by 
making  a  few  observations  at  judiciously  selected  point3.  The  keys  to 
nap-of-the-earth  flight  performance  measurement  will  be  found  in  tne 
construction  of  a  testing  program  that  adequately  samples  decision-making, 
procedural,  and  perceptual-motor  skills  cosmon  to  a  range  of  tactical 
missions,  explicitly  defining  the  indices  of  desired  performance  (in 
quantitative  terms  where  possible)  and  comparing  indices  of  actual  to 
desired  performance  at  the  fewest  critical  points  that  will  yield 
reliable  scores.  Points  critical  for  performance  measurement  need  not 
be  critical  to  the  success  of  the  mission,  or  even  to  the  task  being 
performed.  They  are  critical  only  in  the  sense  that  performance  at 
these  points  correlates  highly  with  overall  performance  of  the  task  or 
mission;  no  direct  cause  and  effect  relationship  need  be  inferred. 

When  synthetic  flight  training  devices  are  used,  automatic  performance 
measurement  is  essential — but  noc  for  the  reasons  usually  given.  There 
is  a  widespread  misconception  that  performance  measurement  has  to  be 
automatic  to  be  objective,  reliable,  and  valid,  none  of  which  is  true. 
Objectivity  has  to  do  with  whether  what  is  being  measured  can  be  observed 
publicly;  as  opposed  to  subjective  measurement  which,  by  definition,  is 
private.  For  two  or  more  people  to  observe  the  same  performance  and 
agree  on  its  quality  or  score,  the  indices  of  desired  performance  must 
be  explicit.  Flight  instructors’  ratings  of  student  performances  are 
subjective  to  the  extent  that  different  instructors  have  their  own  ideas 
about  what  constitutes  correct  or  desired  performance.  Recording  aids 
objectivity  by  making  a  student's  performance  more  nearly  public.  Two 
or  more  observers,  reviewing  the  records  without  distraction  or  personal 
hazard,  are  more  likely  to  arrive  at  the  same  correct  judgment  about 
student  compliance  to  the  explicit  indices  of  desired  performance. 
Automating  the  judgment  between  actual  and  desired  performance  does  not 
make  the  judgment  objective. 

Automatic  measurement  does  not  necessarily  greatly  increase  reliabil¬ 
ity  over  that  of  two  or  mo^e  qualified  observers  'Dannekskiold,  1955; 
Ericksen,  1952;  Gordon,  1949;  Koonce,  1974;  Povenroire,  Alvares  and  Damos, 
I97O*,  Selzer,  Hulin,  Alvare3,  Swartzendruber ,  and  Roscoe,  l?'?’.  Smith, 
Flexman,  and  Houston,  1952),  nor  is  it  related  to  the  validity  of  perfor¬ 
mance  measurement.  Nevertheless,  automatic  performance  measurement  is 
essential  to  any  pilot  training  and  testing  program  that  Incorporates 
adaptive  training  techniques,  computer-assisted  instruction,  or  cross- 
adaptive  side  tasks.  In  all  such  training  innovations,  the  task  (whether 
dec i 8 lon-making,  procedural,  or  p rrceptual -motor )  is  adjusted  in  response 
to  the  pilot' 8  immediately  preceding  performance.  In  practice,  both  the 
scoring  and  the  adjusting  have  to  be  done  automatically  rather  than  by 
the  instructor,  to  assure  continuity  of  operation,  and,  if  in  the  air, 
safety  of  flight.  In  many  situations,  the  instructor  cannot  simultane¬ 
ously  serve  as  safety  pilot  and  observe  critical  dependent  variables 
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at  precisely  die  critical  times. 


CINEMATIC  SIMULATION  . 

As  distinguished  from  conventional  training  films  and  videotaped 
instructional  materials,  cinematic  simulation  refers  specifically  to  the 
open- loop  film  presentation  of  dynamic  visual  scenes.  Used  most  promi¬ 
nently  in  automobile  driver  training,  cinematic  simulation  with  high- 
resolution  wide-angle  color  films  may  provide  the  only  available  cost- 
effective  means  for  teaching  helicopter  pilots  the  perceptual,  procedural, 
and  decision-caking  skills  of  geographic  orientation  in  HOE  flight.  A 
high-fidelity,  closed-loop  visual  simulation  that  would  present  NOE 
flight  up  and  down  canyons,  among  trees  and  buildings,  or  over  and  under 
bridges  and  power  lines  is  not  yet  possible. 

The  principal  limitations  of  cinematic  flight  simulation  methods  are 
resolution,  field  of  view,  and  predetermined  flight  path.  The  image 
resolution  that  can  be  attained  with  modern  films  and  projection  systems 
is  "limited"  only  in  the  sense  that  it  is  less  than  the  resolving  power 
of  the  human  eye  directly  observing  the  field  of  Interest.  Any  other 
method  of  simulating  the  visual  field  (such  as  TV/ terrain-mode l  tech¬ 
niques)  produces  an  image  of  much  poorer  resolution.  Assuming  that  the 
cinematic  simulator  reconstructs  the  geometry  of  the  ”isual  field  so 
that  objects  in  the  projected  image  appear  at  valid  angles  from  the 
observer,  the  best  resolution  of  the  image  would  be  about  five  minutes 
of  arc.  This  is  not  sufficient  resolution  for  NOE  target  acquisition 
task  training  but  is  adequate  for  geographic  orientation  and  map  inter¬ 
pretation  training. 

Cinematic  simulators  are  limited  in  field  of  view  only  by  economics. 

A  full  360-degree  field  of  view  can  readily  be  simulated,  but  If  maximum 
image  resolution  is  to  be  retained  and  image  distortion  is  to  bo 
avoided,  a  multiple  projector  system  is  needed.  The  screen  must  be  a 
section  of  a  sphere  and  only  a  few  observers  (theoretically  only  one) 
can  be  presented  a  valid  simulation  at  any  given  time.  For  practical 
classroom  presentations  of  filmed  materials,  the  maximum  distortion- free 
field  of  view  or.  a  flat  screen  is  approximately  90  degrees. 

The  main  limitation  of  cinematic  simulators  is  that  they  present  a 
predetermined  flight  path;  the  observer  must  go  where  the  photography 
aircraft  went.  Although  cinematic  simulators  can  provide  closed-loop 
control  of  pitch,  roll,  yaw,  and  speed,  the  three  translational  degrees 
of  freedom  are  fixed  by  the  film.  Cinematic  method*  do  not  permit 
students  literally  to  navigate.  Nevertheless,  a  large  number  of  training 
-objectives  can  be  achieved.  Geographic  orientation  at  NOE  altitudes 
involves  detecting  and  identifying  various  types  of  navigational  check¬ 
points,  judging  distances,  seeking  mask,  Interpreting  terrain  forms, 
relating  sighted  features  to  those  portrayed  on  the  map,  snd  making 
navigational  decisions.  Training  exercises  designed  to  Impart  such 
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skills  and  knowledge  have  used  open-loop  cinematic  materials  and  part- 
task  training  methods  and  have  successfull>  trained  Navy  pilots  in  high 
speed,  low-altitude  navigation  (Borden,  1968).  The  application  of 
cinematic  methods  .to  NOE  pilot  training  is  at  least  equally  promising. 


INTERACTIVE  COMPUTER-CONTROL-DISPLAY  DEVICES 

Recent  engineering  developments  may  make  it  possible  to  produce 
tra*'  .ing  systems  of  unprecedented  capability  and  flexibility  at  much 
less  cost  than  contemporary  systems.  Not  only  are  the  unit  costs  of 
integrated  micro-electronic  circuits  falling,  but  promising  new  computa¬ 
tional  techniques  (DeLugish,  19r70;  Voider,  1'999;  WaltUer,  1971)  are 
being  applied  to  flight  training  simulator  development.  Although  the 
developments  are  still  proprietary,  their  potential  applications  are 
great. 

Display  technology  is  also  advancing  rapidly.  Plasma  panel  displays, 
Invented  and  developed  during  the  past  decade  (Hoehn  and  Martel,  IT’l; 
Johnson,  Bitzer  and  Slottow,  1/71' ,  are  ideally  suited  to  computer- 
assisted  instruction  because  they  can  be  driven  directly  by  a  digital 
computer,  and  because  their  inherent  meroo-y  and  selective  erasure 
eliminate  the  high-speed  refreshing  requirement  that  makes  CRT  systems 
expensive.  Because  plasma  panels  are  translucent,  they  can  also  serve 
as  optical  projection  screens.  Although  they  are  still  relatively 
expensive,  their  inherently  simple  construction  promises  eventual  low 
cost,  and  they  consume  little  energy. 

For  certain  applications,  plasma  panels  have  several  disadvantages — 
including  relatively  low  brightness  and  writing  speed.  Also,  they  still 
offer  only  monochromatic  renditions.  However,  very  recent  developments 
in  liquid  crystal  display  technology  appear  to  have  solved  the  fiist  two 
problems,  and  may  eventually  offer  excellent  and  economical  color 
rendition.  Because  liquid  crystal  displays  are  reflective,  the  brighter 
the  ambient  illumination,  the  brighter  the  display.  Their  principle  of 
operation  involves  the  local  modulation  of  reflectivity;  this  is  done 
digitally  at  television  writing  speeds.  Liquid  crystal  displays,  like 
plasma  displays,  are  constructed  in  flat  panels,  are  inherently  simple, 
and  are  potentially  inexpensive.  They  have  great  promise  for  application 
to  simulator  visual  systems,  as  well  as  to  aircraft  cockpit  displays  for 
which  high  ambient  sunlight  has  always  presented  a  serious  problem.  The 
most  advanced  liquid  crystal  displays  are  currently  proprietary  to  their 
developers . 

Both  plasms  panel  and  liquid  crystal  displays  lend  themselves  to 
Interactive  computer-control-display  applications  when  used  in  conjunc¬ 
tion  with  transparent  touch-panel  overlays,  light  pencils,  or  manually 
controlled  cursors.  Used  in  this  manner,  they  provide  highly  flexible 
two-way  commmication  between  the  computer  and  the  student  pilot  or 
instructor,  and  the  ready  implementation  (through  software’'  of  cockpit 
side  tasks,  performance  feedback,  and  changes  in  adaptive  logic.  All 
of  these  may  be  programmed  and/or  selected  from  the  cockpit. 
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CONCLUSIONS 


Simulated  flight  training  devices  have  demonstrated  their  utility  in 
general  helicopter  pilot  training,  but  they  are  limited  in  their  appli¬ 
cations  to  NOE  flight  training  by  the  present  lack  of  a  good  simulation 
of  the  extra-cockpit  visual  field.  The  most  promising  areas  of  appli¬ 
cation  are  in  teaching  the  proceduial  and  decision-naking  skills 
required  for  NOE  operations.  Synthetic  flight  trainers  are  well  suited 
to  training  *lots  in  the  detection  and  diagnosis  of,  and  response  to, 
contingency  and  emergency  events  that  occur  when  operating  at  NOE 
altitudes;  they  should  he  employed  for  this  purpose  at  least.  They  can 
also  be  adapted  to  tactical  decision-making  training,  provided  that  a 
meaningful  situational  context  can  be  set  up  for  each  problem.  The  use 
of  simulated  flight  trainers  to  teach  the  perceptual/motor  skills 
required  in  NOE  flight  will  probably  have  to  await  the  development  of 
high-fidelity  methods  of  simulating  the  visual  field.  In  the  meantime, 
part-task  training,  using  cinematic  methods  combined  with  air  training, 
appears  to  be  the  most  promising  cost-effective  method  of  developing 
visual  perception  skills. 

Automatic  adaptive  trailing  methods  cannot  be  recommended  at  this 
time,  but  they  show  promise  for  teaching  some  of  the  psychcxcotor  skills 
required  in  NOE  aircraft  handling.  In  particular,  precision  hover 
performance  may  be  a  candidate  for  adaptive  training  procedures. 

Computer-assisted  instruction  can  be  applied  to  many  aspects  of  NOE 
training.  Almost  any  part  of  the  curriculum  currently  being  taught  by 
lectures  is  a  candidate  for  CAI  applications.  A  central  terminal  with 
peripherals  in  the  operational  units  could  effectively  aia  advance  unit 
training  by  providing  better  standardization  of  Instruction,  plus  the 
flexibility  an'*  "move-at-your-own  pace"  versatility  that  unit-level 
training  requires.  At  the  entry  level,  CAI  can  provide  some  of  the  same 
advantages  and  particularly  could  teach  student  pilots  the  indices  of 
desired  performance;  this,  in  turn,  would  promote  more  effective  flight 
training.  The  task  analysis  data  produced  by  the  present  research  (Gainer 
and  Sullivan,  1976a,  11776b)  could  be  used  in  developing  computer 
programs  of  performance  indices. 

The  measurement  of  residual  attention  could  be  a  useful  technique  for 
assessing  NOF  pilot  performance,  and  might  also  be  applied  to  stress 
training.  Automatic  performance  measurement  might  also  bo  applied  to 
aircrew  assessment,  but  its  practical  utility  will  depend  on  identifying 
pivotal  measures  that  correlate  highly  with  total  performance. 

The  use  of  interactive  computer-dispiay-control  devices  does  not 
appear  to  have  Immediate  applications  to  NOE  training,  except  as  an 
extension  of  CAI  techniques.  However,  this  developing  technology  shows 
promise  for  future  applications,  particularly  in  the  area  of  NOE  tactical 
decision-naking. 


REFERENCES 


Atkinson,  R.  C.,  4  Wilson,  H..  A.  Computer-assisted  instruction.  In  R.  C. 
Atkinson  and  H.  A.  Wilson  (Eds.)  Computer-assisted  instruction. 

New  York:  Academic  Press,  1969. 

Bauerschmidt,  0.  K. ,  4  Roscoe,  3.  N.  A  comparative  evaluation  of  a  pursuit 
moving-airplane  steering  display.  IF S  Transactions  on  Hunan  Factors 
in  Electronics ,  1960,  HFE-l(Z),  55-61. 

Bauni ,  D.  ?.»  Smith,  J.  F.,  4  Goebel,  R.  A.  Selection  and  analysis  of  UPT 
maneuvers  for  antedated  proficiency  i-'easurement  development.  Brooks 
Air  Force  Base,  TX:  Air  Force  Human  Resources  Laboratory  (AFSC), 
Technical  Report  AFHRL-TR-72-62,  July  1973. 

Bell,  F.  E. ,  III.  Advanced  simulation  in  underg raduictc  pilot  ttaining  IASLPT}  ■ 
technical  fact  sheet.  Brooks  A'.r  Force  Base,  TX:  Air  Force  Human  Resources 
Laboratory  (AFSC),  Technical  Note  AFHRL/FT  TN73-01 ,  May  1974. 


Birmingham.  H.  P.  The  instantaneous  measurement  of  human  bandwidth. 

Naval  Research  Laboratory,  Washington,  DC.  Paper  presented  at  the 
8th  Annual  Conference  on  Manual  Control.  Dunlap  and  Associates, 
Inc.,  Stamford,  CT,  May  1959. 

Birmingham,  H.  P.,  Chernikoff,  R.,  4  Ziegler,  P.  N.  The  design  and  use 
of  "equalization”  teaching  machines.  Naval  Research  Laboratory, 
Washington,  DC.  Paper  presented  at  the  IRE  International  Conyr"ss 
on  Human  Factors  in  Electronics,  Long  Beach,  CA,  May  1962. 

Bitter,  D.  L.,  4  Johnson,  R.  L.  PLAT0--a  computer-based  system  used  in 
the  engineering  of  education.  IEEE  Proceedings  (Special  .issue  on 
Engineering  Education),  1971,  59,  960-968. 

Borden,  G.  J.  Training  pilots  in  the  use  of  aeronautical  charts:  a 

conference  report.  Goleta,  CA:  Human  Factors  Research,  Inc.,  for 
JANAIR,  NR  213-028,  January  1968. 

Caro,  P.  W.,  Jr.  Adaptive  training--an  application  to  flight  simulation. 
Human  Factors,  1969,  11,  569-575. 

Caro,  P.  W. ,  Jr.  Transfer  of  instrument  training  and  the  synthetic  flight 
training  system.  Alexandria,  VA:  Human  Resources  Research 
Organization,  Professional  Paper  7-72,  May  1972. 

Caro,  P.  W.,  Jr.  Aircraft  simulators  and  pilot  training.  Human  Factors, 
1973,  IS,  503-5*0. 


-  17  - 


Chernikoff,  R.  Human  equalization:  concept,  machine,  and  measurement. 

In  Complex  vehicular  controls:  proceedings  of  Office  of  Naval 
Research  symposium,  Famborough,  England.  Long  Beach,  CA:  Douglas 
Aircraft  Co.,  Inc.,  May  1962: 

Clausen,  J.  T.,  Curtin.  J.  G.,  A  Egler,  J.  F.  Concept  formulation  report, 
synthetic  flight  training  system  Depice  2824.  Orlando,  FL:  Naval 
Training  Device  Center,  Technical  Report  NAVTRADEVCEN-68-C-0108-1 , 
July  1968.  (AD  673  982} 

Crooks,  W.  H.,  A  Roscoe,  S.  N.  Varied  and  fixed  error  limits  in  automated 
adaotive  skill  training.  In  M.  P.  Rane,  Jr.  and  T.  M.  Malone  (Eds.) 
Proceedings  of  the  seventeenth  annual  meeting  of  the  Human  Factors 
Society.  Santa  Monica,  CA:  Human  Factors  Society,  October  197?. 

Crowder,  N.  A.  Automatic  tutoring  by  means  of  intrinsic  programming.  In 
E.  Galariter  (Ed.)  Automatic  teaching.  New  York:  John  Wiley,  1959. 

Damos,  D.  L.  Cross-adaptive  measurement  of  residual  attention  to  predict 
pilot  performance.  Savoy,  IL:  University  of  Illinois  at  Urbana- 
Champaior.,  Institute  of  Aviation,  Aviation  Research  Laboratory, 
Technical  Report  ARL-72-25/AF0SR-72-12,  October  1972. 

Damos,  D  L. ,  A  Roscoe,  S.  N.  Cross -adaptive  measurement  of  residual 

attention  in  pilots.  Savoy,  IL:  University  of  Illinois  at  Urbaria- 
Chamr-aign,  Inst i t i te  of  Aviation,  Aviation  Research  Laboratory, 
Technical  Report  ARL-70-S/AF0SR-70-2,  October  1970. 

Danneskiold,  R.  D.  Objective  scoring  procedure  for  operational  flight 

trainer  performance.  Port  Washington,  NY:  Office  of  Naval  Research, 
Special  Devices  Center,  Technical  Report  SPECDEVCEN-TR-999-2-4, 
February  1955.  (AD  149  547) 

DeLugish,  B.  G.  A  class  of  algorithms  for  automatic  evaluation  of  certain 
elementary  functions  in  a  binary  computer.  Urbana,  IL:  University 
of  Illinois  at  Urbana-Champaign,  Department  of  Computer  Sciences, 
Report  3S9,  June  1970. 

EhrhanJL,  L.  E.,  Cavallero,  F.  R.,  A  Kennedy,  R.  S.  Effect  of  a  prediction 
display  on  carrier  landing  performance- -Part  2:  laboratory 
mechanization.  Pt.  Mugu,  CA:  Naval  Missile  Center,  Laboratory 
Department,  Final  Report,  Project  Order  P0-2-0151,  NR  196-106A, 

June  1973. 

Ekstrom,  P.  Analysis  of  pilot  workloads  in  flight  control  systems  with 
different  degrees  of  automation.  Paper  presented  at  the  Institute 
of  Radio  Engineers  International  Congress  on  Human  Factors  in 
Electronics,  Long  Beach,  CA,  May  1962. 


ErlcksW)  S.  C.  A  retrieu  of  the  literature  on  methods  of  measuring  pilot 
prcfiaikney.  lackland  Air  Force  Base,  TX:  Human  Resources  Research 
Center,  Research  Bulletin  52-25,  1952. 

F adders* n,  W.  E.  The  effect  of  simulator  notion  upon  system  and  operator 
performance.  Paper  presented  at  the  Seventh  Annual  Army  Human 
Factors  Engineering  Conference,  Ann  Arbor,  HI,  October  1951., 

Flexman,  R.  E.,  Matheny,  W.  6.,  A  Brown,  E.  L.  Evaluation  cf  r.ne  School 
link  and  special  methods  of  instruction  in  a  ten-hour  priva*3  pilot 
flight-training  program.  University  of  Illinois  Bulletin,  1950, 
*7(80),  Aeronautics  Bulletin  8. 

Flexman,  R.  E.,  Roscoe,  S.  N.,  Williams,  A.  C. ,  dr.,  A  Willlges,  B.  H. 
Studies  in  pilot  training:  the  anatomy  of  transfer.  Aviation 
Research  Monographs ,  1972,  2(1). 

Flexman,  R.  £.,  Townsend,  J.  C.,  A  Ornstein,  G.  h.  Evaluation  of  a  contact 
flight  simulator  when  used  in  an  Air  Force  primary  pilot  training 
program:  Part  1:  overall  effectiveness .  lackland  Air  Force  Base, 
TX:  Air  Force  Personnel  and  Training  Research  Cente-,  Technical 
Report  AFPTRC-7R-54-38,  September  1954.  (AD  53730) 

Galnar,  C.  A.  and  Sullivan,  D.  J.  KiA.CA.ev)  le.quA  fiemciit 4  <0*  nap-o^- ths-eaAth 
6£i ght.  ARI  Research  Report  1190.  1976.  (a) 

Gainer,  C.  A.  and  Sullivan,  o.  J.  Ki.t clew  tmk  areJuiii  and  tAa.in/rg 
abjective, 6  {oh  nap-0 i- the- COAth  digit.  ARI  Research  Memorandum 
76-2.  1976.  (b) 

Glaser,  R.  (Ed.).  Teaching  machines  and  programed  instruction,  II. 

Washington,  DC:  National  Education  Association,  1965. 

Gordon,  T.  A.  The  development  of  a  standard  flight  check  for  the  airline 
transport  rating  based  on  the  critical  requirements  of  the  airline 
pilot's  job.  Washington,  DC:  Civil  Aeronautics  Administration, 
Division  of  Research,  Report  85,  1949. 

Guerclo,  J.  G.,  A  Wall,  R.  L.  Congruent  and  spurious  motion  in  the 

learninq  and  performance  of  a  compensatory  tracking  task,  daman 
Factors ,  1972,  14,  259-269. 

Hamilton,  P.  Selective  attention  in  multi -source*  monitoring  tasks. 

Journal  of  Experimental  Psychology ,  1969,  32,  34-37. 

Hartman,  B.  0.,  A  McKenzie,  R.  E.  Systems  operator  proficiency :  effects 
of  speed  stress  an  overload  perf irmance.  .  Brooks  Air  Force  Base, 

TX:  School  of  Aerospace  Medicine,  Report  61-40,  June  1961. 

Hoehn,  J.  H. ,  A  Martel,  R.  A.  A  60-line  per  inch  plasma  display  panel. 

IEEE  Transactions  on  Electron  Devices,  1971,  ED-18{ 9),  659-663. 

Holding,  D.  H.  Principles  of  training.  London:  Pergamon  Press,  1965. 

Hudson,  E.  M.  An  adaptive  tracking  simulator.  Otis  Elevator  Comoany, 
Brooklyn,  NY.  Paper  presented  at  the  IRE  First  International 
Congress  on  Human  Factors  In  Electronics,  long  Beach,  CA,  May  1562. 


-  19  - 


Hudson,  £.  M.  Adaptive  training  and  nonverbal  behavior.  Port  Washington, 
hf Naval  Training  Oevice  Center,  Technical  Report  1395-1  ,  July  1964. 

Ince,  F.,  Williges,  R.  A  Roscce,  S.  N.  Simulator  motion  and  the  order 
of  merit  of  flight  attitude  and  steering  guidance  displays.  In 
H.  P.  Rane,  Jr.  and  T.  M.  Malone  (Eds,)  Proceedings  of  the  seventeenth 
annual  meeting  of  the  Human  Factors  Society.  Santa  Monica,  CA: 

Human  Factors  Society,  October  1973. 

Jacobs,  R.  S. ,  Williges,  R.  C.,  S  Roscoe,  S.  N.  Simulator  motion  as  a 

factor  in  fllght-d ircctor  display  evaluation.  Human  Factors,  1973, 

15,  573-586. 

Jameson,  W.  P.,  Walsh,  J.  M.,  Flexman,  R.  t.,  S  Cohen,  E.  Synthetic 

flight  training  system  fSFTS):  concept  formulation  report.  Orlando, 
FL:  Naval  Training  Device  Center,  Technical  Report  NAVTRADEVCEN-68- 

C-0106-1,  April  1968. 

Johnson,  R.  L.,  Bitzer,  D.  L.,  8  Slottow,  G.  H.  The  device  characteristics 
of  the  plasma  display  element.  TFF.F  Transactions  on  Electron 
Devices ,  1971,  ED~1‘!( 9),  612-649. 

Johnson,  S.  L.,  J  Roscoe,  S.  H.  What  moves,  the  airplane  or  the  world? 

Human  Factors,  197 2,  14,  107-129. 

Kelley,  C.  R.  Testing  the  effects  of  extended  space  missions  on  piloting 
Skill.  In  E.  Burgess  (Ld.)  A  AS  science  and  technology.  Vol.  5, 

P.  Horowitz  (Ed.)  Physiologies!  and  perform. mce ■  dot. cm t.t  of 
manned  apace  system  design.  Baltimore,  MD;  American.  Astronautical 
Society,  1965. 

Kelley,  C.  R.  Self-adjusting  vehicle  simulators.  In  C.  R.  Kelley  (Ed.) 

The  predictor  .instrument :  final  report  and  surtneru  of  project 
activities  during  1961.  Arlington,  V A:  Office  of  Nava!  Research 
Technical  Report,  Contract  Nonr  2822(00),  January  1962.  Also  in 
C.  R.  Kelley  (Ed.)  Adaptive  pirvuLcti.cn.  Arlington,  VA:  Office 
of  Naval  Research  Final  Report,  Contract  Nonr  4986(00),  August  I960. 

(AD  637  658) 

Kelley,  C.  R.  Further  research  with  adavtive  tasks.  Arlington,  VA: 

Office  of  Naval  Research  Final  Report,  Contract  Nonr  4986(0')), 

August  1967. 

Kelley,  C.  R.  Adaptive  and  automated  research  techniques  from  engineering 
psychology.  American  Psychologist,  1969,  24,  293-297. (a) 

Kelley,  C.  R.  What  is  adaptive  training?  Human  Factors,  1969,  11,  547- 
556. (b) 


Kelley,  C.  R. .  A  Prosin,  0.  J.  Adaptive  performance  measurement.  Arlington, 
VA:  Office  of  Naval  Research  Final  Report,  Contract  Nonr  4986(00), 
August  1968.  (AO  677  049) 

Kelley,  C.  R.,  I  Wargo,  M.  J.  Cross-adaptive  operator  loading  tasks. 

Human  Factors,  1967,  9,  395-404. 

Knoop,  P.  A.  Programing  techniques  for  the  automatic  monitoring  of  hesan 
performance.  Wright-Patterson  Air  Force  Base,  OH:  Aerospace  Medical 
Research  Laboratory,  Technical  Report  AMRL-TR-66-16,  April  1966. 

Knoop,  P.  A.  Automated  aids  for  flight  simulator  Instructors.  USAF 
Instructor's  Journal,  1967,  4{ 4),  51-64. 

Knoop,  P.  A.  Development  and  evaluation  of  a  digital  computer  program  for 
automatic  human  performance  monitoring  in  flight  simulator  training. 

Wright-Patterson  Air  Force  Base,  OH:  Aerospace  Medical  Research 
Laboratories,  Technical  Report  AMRL-TR-67-97,  August  1968. 

Koonc;,  J.  M.  Effects  of  ground-based  aircraft  simulator  motion  conditions 
upon  prediction  of  pilot  proficiency .  Savoy,  IL:  University  of 
Illinois  at  Ur bana -Champaign,  Institute  of  Aviation,  Aviation  Research 
Laboratory,  Technical  Report  ARL-74-5/AFQSR-74-3,  April  1974. 

Kraus,  E.  F  ,  $  Roscoe,  S.  N.  Reorganization  of  airplane  manual  flight 
control  dynamics.  In  W.  B.  Knowles,  M.5.  Sanders,  arid  F.  A. 

Muckier  (Eds.)  Proceedings  of  the  sixteenth  annual  meeting  of  the 
Human  Factors  Society. 

Lazarus,  R.  S. ,  Deese,  J.  E.,  &  Osier,  S.  F.  The  effects  of  psychological 
stress  upon  performance.  Psychological  Bulletin,  1952,  43,  293-317. 

Lewis,  B.  N.,  &  Pask,  G.  The  theory  and  practice  of  adaptive  teaching 
systems.  In  R.  Glaser  (Ed.)  Teaching  machines  and  programmed 
learning.  Vbl.  II:  data  and  directions.  Washington,  DC:  National 
Education  Association,  1965. 

Mndsay,  P.,  Taylor,  M. ,  S  Forbes,  S.  Attention  and  multidimension 

discrimination.  Perception  and  Psychophysics ,  1968,  4,  113-117. 

Lowes,  A.  L.,  Ellis,  N.  C.,  Norman,  0.  A. ,  S  Matheny,  W.  G.  Improving 
piloting  skills  in  turbulent  air  using  a  self-adaptive  technique 
far  a  digital  operational  flight  trainer.  Orlando,  FL:  Naval 
Training  Device  Center,  Technical  Report  NAVTRADEVCEN  67-C-0034-2 , 
August  1968.  (AD  675  305) 

Lumsdaine,  A.  A.,  &  Glaser,  R.  (Eds.).  Teaching  machines  and  programed 
learning:  a  source  book.  Washington,  DC:  National  Education 
Association,  1960. 

-  21  - 


Matheny,  W.  6.,  Dougherty,  D.  J.,  &  Willis,  J.  M.  Relative  motion  of 
elements  In  instrument  displays.  Aerospace  Medicine ,  1963,  34, 
1041-1046. 

Matheny,  W.  G.,  &  Norman,  D.  A.  The  effective  time  constant-  in  tracking 
behavior ,  Orlando,  FL:  Naval  Training  Device  Center,  Technical 
Report  NAVTRADEVCEN  67-C-0034-3,  August  1968. 

McGrath,  J.  J.  The  use  of  wide-angle  cinematic  simulators  in  pilot 

training.  5anta  Barbara,  CA:  Anacapa  Sciences,  Inc.,  Technical 
Report  NAVTRADEVCEN  70-C-0306-4,  June  1972. 

McGrath,  J.  J.,  &  Harris,  0.  H.  Adaptive  training.  Aviation  Research 
Monographs ,  1971,  1 ( 2 ) . 

Mongel koch,  R.  F,,  Adams,  J.  A.,  &  Gainer,  C.  A.  The  forgetting  of 
instrument  flying  skills  as  a  function  of  the  level  of  initial 
proficiency.  Port  Washington,  NY:  Office  of  Naval  Research,  Naval 
Training  Device  Center,  Technical  Report  NAVTRADEVCEN  71-16-18,  1958. 

Mlchuli,  6.  S.  Analysis  of  transfer  of  training ,,  substitution,  and 

fidelity  of  simulation  of  training  equipment.  Orlando,  FL:  Naval 
Training  Equipment  Center,  Training  Analysis  and  Evaluation  Group, 
TAI.fi  Report  2,  1972. 

Mir/«bt'lla,  A.,  U  Lamb,  J.  C.  Computer  based  adaptive  training  applied  to 
symbolic  displays.  Perceptual  and  Motor  Skills,  1966,  23,  647-661. 

Nyyaard,  J.  C .  ,  &  Roscoe,  S.  N.  Manual  steering  display  studies:  I. 

Irinpi-iy-cnntrol  pel  at ionahipe  and  the  configuration  of  the  steering 

symbol,  Culver  City,  CA:  Hughes  Aircraft  Company,  Technical 
Memorandum  334,  October  1953. 

OniUain,  G.  N.,  Nichols,  1.  A.,  4  Flexman,  R.  E.  Evaluation  of  a  contact 
flight  simulator  whan  used  in  an  Air  Force  primary  pilot  training 
program,  Part  If.  Effectiveness  of  training  on  component  skills, 
lackland  Air  Force  Base,  TX:  Air  Force  Personnel  and  Training 
Research  Centor,  Technical  Report  AFPTRC-TR-54-110,  December  1954. 

(AD  62373) 

Cask,  G.  Adaptive  teaching  with  adaptive  machines.  In  A.  A.  Lumsdaine 
and  R.  Glaser  (Eds,)  Teaching  machines  and  programed  learning:  a 
source  book,  Washington,  DC:  National  Education  Association,  1960, 
349-366. 

Paifc,  0.,  6  Lewis,  0.  N.  An  adaptive  eifcomatinn  for  teaching  small  groups. 
Perceptual  and  Motor  Skills,  1962,  14,  183-188. 

I'nyne,  T.  A.,  Dougherty,  0.  J.,  Master,  S.  G.,  Skeen,  J.  R.,  Brown,  E.  L., 
h  Williams,  A.  C.,  Jr.  Improving  landing  performance  using  a  contact 
laivllna  trainer,  Port  Washington,  NY:  Office  of  Nuv^l  Research, 
Special  Oovices  Canter,  Technical  Report  SPECDEVCEN  71-16-11,  March 
1904.  (AD  121  200) 


IM«-c_V< 


Pope,  L.  T.  Attention  level  and  visual  and  auditory  monitoring  perforrnance. 
Wright-Patterson  Air  Force  Case,  OH:  Behavioral  Sciences  Laboratory, 
Technical  Documentary  Report  MRL-1 DR-62-97,  August  1962. 

Povenmire,  H.  K. ,  Alvares,  K.  M.,  u  Damos,  D.  L.  Observer-obsem'e v  flight 
check  reliability.  Savoy,  IL:  University  of  Illinois  at  Urbana- 
Champaign,  Institute  of  Aviation,  Aviation  Research  Laboratory, 
Technical  Report  LF-70-2,  October  1970. 

Povenmire,  H.  K,  4  Roscoe,  S.  N.  An  evaluation  of  ground-based  flight 
trainers  in  routine  primary  flight  training.  Human  Factors ,  1971, 

33,  109-116. 

Povenmire,  H.  K. ,  &  Roscoe,  S.  N.  The  incremental  transfer  effectiveness 
of  a  ground-based  general  aviation  trainer.  Human  Factors ,  1973, 

35,  537-545. 

Fuig,  J.  A.  Motion  in  flight  training.  Orlando,  FL:  Naval  Training 

Device  Center,  Technical  Report  NAVTRADEVCEN  IH- 177,  October  1970. 

Roscoe,  S.  N.  The  effects  of  eliminating  binocular  and  peripheral 

monocular  visual  cues  upon  airplane  pilot  performance  in  landing. 

Journal  of  Applied  Psychology  %  1948,  32,  649-662. 

Roscoe,  S.  N.,  Denney,  D.  C.,  &  Johnson,  S.  L.  The  frequency-separated 
display  principle:  Phase  II.  Savoy,  IL:  University  of  Illinois 
at  Urbana-Champaign,  Institute  of  Aviation,  Aviation  Research 
Laboratory,  Annual  Summary  Report  ARL-71 -1 5/0NR-71  -1 ,  December  1971. 

(AD  73E  915} 

Roscoe,  S.  N.,  Hasler,  S.  G.,  4  Dougherty,  D.  J.  Flight  by  periscope: 

making  takeoffs  and  landings;  the  influence  of  image  magnification, 
practice,  and  various  conditions  of  flight.  Human  Factors,  1966, 

8,  13-40. 

Roscoe,  S.  N. ,  Hopkins,  C.  0. ,  &  McCurley,  E.  A.  Manual  steering  display 
studies:  III.  The  tiansition  of  interceptor  pilots  to  the  moving- 
airplane  display  in  the  F-86D  aircraft.  Culver  City,  CA;  Hughes 
Aircraft  Company,  Section  2.0  of  Report  507-03-P,  December  1955. 

Roscoe,  S.  N. ,  &  Kraus,  E.  F.  Pilotage  error  and  residual  attention:  the 

evaluation  of  a  performance  control  system  in  airborne  area  navigation. 
Navigation ,  1973,  20.  267-279. 

Roscoe,  S.  N.,  4  Willlges,  R.  C.  Motion  relationships  in  aircraft 

attitude  and  steering  guidance  displays:  a  flight  experiment.  In 
M.  P.  Ranc,  Jr.  and  T.  M.  Malone  (Eds.)  Proceedings  of  the 
seventeenth  annual  meeting  of  the  Human  Factors  Society.  Santa 
Monica,  CA:  Human  Factors  Society,  October  1973. 


-  23  - 


---r  -i  -  • 


i  rim  if 


'?-y7~  ^^^VT-T/'V’t-'v.’-T,?! 


Roscoe,  S.  N. ,  Wilson,  K.  V.,  &  Deming,  H.  D.  Manual  steering  display 
studies:  II.  T  he  transition  if  skilled  interceptor  pilots  from 
the  E-series  display  to  the  moving  airplane  display.  Culver  City, 

CA:  Hughes  Aircraft  Company,  Technical  Memorandum  331,  November  1954 


Seibel,  R.,  Christ,  R.  E.,  &  Teichner,  W.  H.  Short-term  memory  under 
workload  stress.  Journal  of  Experimental  Psychology ,  1965,  70, 
154-162. 


Selzer,  U.,  Hulin,  C.  L.,  Alvares,  K.  M, ,  Swartzendruber,  L.  E.,  A  Roscoe 
S.  N.  Predictive  validity  of  ground-based  flight  checks.  In  W.  B. 
Knowles,  M.  S.  Sanders,  and  F.  A.  Muckier  (Eds.)  Proceedings  of  the 
sixteenth  annual  meeting  of  the  Human  Factors  Society.  Santa  Monica, 
C.A:  Human  Factors  Society,  October  1972. 

Skinner,  B.  F.  Teaching  machines.  Science ,  1958,  128,  969-977. 

Slocum,  G.  K. ,  Williges,  B.  H.,  &  Roscoe,  S.  N.  Meaningful  shape  coding 

for  aircraft  switch  knobs.  Aviation  Research  Monographs,  1971,  2(3), 
27-40. 


Smith  J.  F.  Applications  of  the  advanced  simulation  in  undergraduate 

pilot  training  (ASUPT)  research  facility  to  pilot  training  programs. 
In  E.  B.  Tefcbs  (Ed.)  Third  annual  symposium:  proceedings  of 
psychology  in  the  Air  Force.  Colorado  Springs,  CO:  USAF  Academy, 
Department  of  Life  Sciences,  April  1972. 

Smith,  0.  F.,  Flexman,  R.  E. ,  &  Houston,  R.  C.  Development  of  an  objective 
method  of  recording  flight  performance.  Lackland  Air  Force  Base, 

TX:  Human  Resources  Research  Office,  Technical  Report  52-15, 

December  1952. 

Smith,  M.  Effect  of  varying  channel  capacity  on  stimulus  detection  and 
discrimination.  Journal  of  Experimental  Psychology ,  1969,  82, 
520-526. 


Smode,  A.  F.,  Hall,  E.  R.,  &  Meyer,  D.  E,  An  assessment  of  research 

relevant  to  pilot  training.  Wright-Patterson  Air  Force  Base,  OH: 
Aerospace  Medical  Research  Laboratory,  Technical  Report  AMRL-TR-66- 
196,  November  1966.  (AD  804  600) 

Soliday,  S.  M.,  &  Schohan,  B.  Task  loading  of  pilots  in  simulated  low- 
altitude  high-speed  flight.  Human  Factors,  1965,  ?,  45-53. 


Trollip,  S.  R. ,  &  Roscoe,  S.  N.  Computer-assisted  instruction  in  pilot 
training  and  certification.  In  W.  B.  Knowles,  M.  $.  Sanders,  and 
F.  A.  Muckier  (Eds.)  Proceedings  of  the  sixteenth  annual  meeting  of 
the  Human  Factors  Society.  Santa  Monica,  CA:  Human  Factors  Society, 
October  1972. 

-  24  - 


V  V» 


"T" 


'*•  ■  !■ ",  wi1  J.fl'pjV'.riT 


Val verde,  H.  H.  Flight  simulators.  A  review  of  the  research  and  development.. 
Wright- Patterson  Air  Force  Base,  OH:  Aerospace  Medical  Research 
Laboratory,  Technical  Report  AMRL-TR-68-97,  July  1968.  (AD  855  582) 

Val verde,  H.  H.  A  review  of  flight  simulator  transfer  of  training  studies. 
Human  Factors ,  1973,  25(6),  510-522. 

Voider,  J.  E.  Tne  CORDIC  trigonometric  computing  technique.  IEEE 
Transactions  on  Electronic  Computers,  1959,  EC- 8 (5),  330-334. 

Walsh,  J.  M. ,  &  Flexman,  R.  E.  Preliminary  adaptive  training  design  report 
for  synthetic  flight  training  system  Device  2B24.  Orlando,  FL: 

Naval  Training  Device  Center,  Technical  Report  59-C-0200-15,  April 
1970. 

Walther,  J.  S.  A  unified  algorithm  for  elementary  functions,  afips 
Conference  Proceedings ,  1971,  38,  379-385. 

Watson,  W.  W. ,  Codes,  H.  D.,  &  Hotz,  H.  E.  TutuJ te  undergraduate  pilot 
training  system  study:  Appendix  XII.  Candidate  synthetic  flight 
training  requirements.  Wright-Patterson  Air  Force  Base,  OH: 

Aeronautical  Systems  Division,  Air  Force  Systems  Command,  Final 
Report  NOR  70-149?.  March  1971. 

Weisz,  A.  Z.,  Elkind,  J.  I.,  Pierstorff,  B.  C.,  &  Sprague,  L.  T.  Evaluation 
of  aircraft  steering  displays.  IRE  Transactions  on  Humo.,.  Factors 
in  Electronics ,  i960,  HFE- 1 (2 ) ,  55-61. 

Williams,  A.  C.,  Jr.,  &  Flexman,  R.  E.  An  (•valuation  of  the  CiUf  operational 
trainer  as  an  aid  in  contact  flight  training.  Port  Washington,  NY: 
Office  of  Naval  Research,  Special  Devices  Center,  Technical  Report 
71-16-5,  July  1949. (a) 

Williams,  A.  C.,  Jr.,  &  FI exmen,  ft.  E.  Evaluation  of  the  School  Link  as 
an  aid  in  primary  flight  instruction.  University  of  Illinois 
Bulletin,  1949,  45(71),  (Aeronautics  Bulletin  5 ) . (b) 


Williams,  A.  C.,  Jr.,  &  Flexman,  R.  E.  The  efficiency  of  a  synthetic 

flight  training  device  as  a  function  of  its  design  characteristics. 
American  Psychologist,  1949,  4,  301. (c) 

Wiiliges,  B.  H.,  P.oscoe,  S.  N.,  &  Williges,  R.  C.  Synthetic  flight 
training  revisited.  Human  Factors ,  1973,  25,  549-564. 

Wood,  M.  E.  Continuously  adaptive  versus  discrete  changes  of  task  difficulty 
in  the  training  of  a  complex  perceptual -motor  skill.  Proceedings 
of  the  77th  Annual  Convention  of  the  American  Psychological  Association , 

1969,  4,  757-758. 


1 /*/>.»*  V*. 


-  25 


rr,ra  f"  *  T7rv. ' 


Mjlfeck,  J.  W. ,  Prosin,  D.  J.,  &  Burger,  W.  J.  Effect  of  a  prediction 
display  on  carrier  landing  performance— ‘Pott  1:  experimental 
evaluation.  Inglewood,  CA:  Dunlap  and  Associate?,  Inc.  Final 
Report,  Contract  N00014-71-C-0252,  NR  196-106*  June  1973. 

Young,  F.  E.,  &  Hall,  E.  R.  Synthetic  flight  trainer  system  (2B24): 
concept  formulation  report.  Orlando,  FL:  Naval  Training  Device 
Center,  Technical  Report  NAVTRADEVCEN  68-C-0107-1,  July  1968. 


-  26  - 


